Vehicle camera lvds repeater

ABSTRACT

A vision system of a vehicle includes a camera disposed at a vehicle and having a field of view exterior of the vehicle. The camera captures image data and outputs a low voltage differential signal (LVDS). The system includes an LVDS repeater that receives the LVDS signal output by the camera and outputs at least two LVDS outputs to respective receivers. Each of the at least two LVDS outputs is representative of the LVDS signal output by the camera. The receivers include a receiver of respective ones of at least two devices selected from the group consisting of (i) a vehicle head unit, (ii) a display device, (iii) an electronic control unit of the vehicle and (iv) an image processor for a driver assistance function.

CROSS REFERENCE TO RELATED APPLICATION

The present application claims the filing benefits of U.S. provisionalapplication Ser. No. 62/408,954, filed Oct. 17, 2016, which is herebyincorporated herein by reference in its entirety.

FIELD OF THE INVENTION

The present invention relates generally to a vehicle vision system for avehicle and, more particularly, to a vehicle vision system that utilizesone or more cameras at a vehicle.

BACKGROUND OF THE INVENTION

Use of imaging sensors in vehicle imaging systems is common and known.

Examples of such known systems are described in U.S. Pat. Nos.5,949,331; 5,670,935 and/or 5,550,677, which are hereby incorporatedherein by reference in their entireties. FIG. 2 shows a commonimplementation block diagram of a digital camera of a vehicle with a LowVoltage Differential Signaling (LVDS) signal output to a vehicle headunit/display in the vehicle.

SUMMARY OF THE INVENTION

The present invention provides a driver assistance system or visionsystem or imaging system for a vehicle that utilizes one or more cameras(preferably one or more CMOS cameras) to capture image datarepresentative of images exterior of the vehicle, and provides a methodof duplicating (or repeating) an automotive camera signal two or moretimes. The present invention provides a means to repeat the LVDS signalto multiple outputs. The system is preferably a plug and play typesystem that allows for application of the repeater to various cameraapplications or vision system applications or driver assistance systemsor the like.

These and other objects, advantages, purposes and features of thepresent invention will become apparent upon review of the followingspecification in conjunction with the drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a plan view of a vehicle with a vision system thatincorporates cameras in accordance with the present invention;

FIG. 2 is a known implementation block diagram of a digital camera withLow Voltage Differential Signaling (LVDS) signal output in a vehicle;

FIG. 3 is a block diagram showing use of an LVDS splitter in accordancewith the present invention;

FIG. 4 is a block diagram of an LVDS splitter of the present invention;and

FIG. 5 is a block diagram of another LVDS splitter of the presentinvention.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

A vehicle vision system and/or driver assist system and/or objectdetection system and/or alert system operates to capture images exteriorof the vehicle and may process the captured image data to display imagesand to detect objects at or near the vehicle and in the predicted pathof the vehicle, such as to assist a driver of the vehicle in maneuveringthe vehicle in a rearward direction. The vision system includes an imageprocessor or image processing system that is operable to receive imagedata from one or more cameras and provide an output to a display devicefor displaying images representative of the captured image data.Optionally, the vision system may provide display, such as a rearviewdisplay or a top down or bird's eye or surround view display or thelike.

Referring now to the drawings and the illustrative embodiments depictedtherein, a vehicle 10 includes an imaging system or vision system 12that includes at least one exterior facing imaging sensor or camera,such as a rearward facing imaging sensor or camera 14 a (and the systemmay optionally include multiple exterior facing imaging sensors orcameras, such as a forward facing camera 14 b at the front (or at thewindshield) of the vehicle, and a sideward/rearward facing camera 14 c,14 d at respective sides of the vehicle), which captures images exteriorof the vehicle, with the camera having a lens for focusing images at oronto an imaging array or imaging plane or imager of the camera (FIG. 1).Optionally, a forward viewing camera may be disposed at the windshieldof the vehicle and view through the windshield and forward of thevehicle, such as for a machine vision system (such as for traffic signrecognition, headlamp control, pedestrian detection, collisionavoidance, lane marker detection and/or the like). The vision system 12includes a control or electronic control unit (ECU) or processor 18 thatis operable to process image data captured by the camera or cameras andmay detect objects or the like and/or provide displayed images at adisplay device 16 for viewing by the driver of the vehicle (althoughshown in FIG. 1 as being part of or incorporated in or at an interiorrearview mirror assembly 20 of the vehicle, the control and/or thedisplay device may be disposed elsewhere at or in the vehicle). The datatransfer or signal communication from the camera to the ECU may compriseany suitable data or communication link, such as a vehicle network busor the like of the equipped vehicle.

FIG. 2 shows a common implementation block diagram of a digital camerawith Low Voltage Differential Signaling (LVDS) signal output in avehicle. This shows a standard implementation or block diagram ofDigital (LVDS) Camera in ADAS. The camera (1) creates an image of theenvironment, and outputs it in LVDS (2) electrical signal format. TheLVDS is received by one and only receiver, such as Vehicle Head-unit (3)for display. Due to the nature of an LVDS signal, and underlyingencoding schemes employed, the LVDS signal cannot be simply “Y”connected for consumption of 2 or more receivers. Thus there is a needof a device or method to “repeat” the LVDS signal for consumption ofmultiple receivers.

FIG. 3 shows an LVDS splitter (4) as used in an example vehicleapplication, such as a system with three or four receivers. The camera(1) captures image data representative of an image of the environment,and outputs it in LVDS (2) electrical signal format. The LVDS isreceived by an LVDS Splitter/Repeater (4). The LVDS Repeater outputs theimage to three receivers in this example—a head-unit (5), a firstelectronic control unit or ECU1 (6) and a second electronic control unitor ECU2 (7).

As shown in FIG. 4, an embodiment or internal block diagram of theproposed LVDS Splitter (4) includes an LVDS input (34) and three LVDSoutputs (45, 46, 47). The LVDS signal is received from the camera orLVDS source via connector (34), and provided to a complimentaryde-Serializer (35). In Automotive LVDS signals, the Source Serializerand Receiving De-Serializer should be complementary or from the samefamily, so the encoding, decoding and encryption protocols match. TheDe-Serializer transmits signals to a field-programmable gate array orFPGA (37). These signals may be in MIPI (36) format as shown in FIG. 4,or they may be Parallel, depending on type of de-Serializer used.

The FPGA (37) performs the repeating of signals function and outputs thesame data to multiple MIPI (Mobile Industry Processor Interface) buses.In the example embodiment of FIG. 4, the FPGA performs a 1:3 repeatfunction, and outputs data to three busses: (38), (39), (40), which arethen encoded into LVDS signals by Serializer1 (42), Serializer2 (43),Serializer3 (44), respectively. The repeated LVDS data is output on 3connectors (45), (46), (47).

Optionally, the Automotive LVDS bus may also have Power-Over-Coax (PoC)Capability. If such a feature is in use in the vehicle LVDS bus, theproposed repeater design can make full use of such PoC. The design iscapable to use this power for the repeater itself, and the connectedremote camera on connector (34). This PoC utilization is describedbelow.

As shown in FIG. 4, the diode D1 routes PoC voltage Vpoc1 to Vpoc, thusif the receiver connected on (45) has a PoC source capable to power therepeater and camera, Vpoc1 can source the desired current. The diode D2routes PoC voltage Vpoc2 to Vpoc, thus if the receiver connected on (46)has a PoC source capable to power the repeater and camera, Vpoc1 cansource the desired current. Likewise, the diode D3 routes PoC voltageVpoc3 to Vpoc, thus if the Receiver connected on (47) has a PoC sourcecapable to power the repeater and Camera, Vpoc3 can source the desiredcurrent. Moreover, such a configuration allows for current superpositionfrom multiple PoC sources connected to either (45), (46), (47) in anycombination. This is useful if one PoC source receiver does not havesufficient current capability to drive the whole system (e.g., cameraand repeater).

If No PoC source is present, or PoC Source(s) do not have enough currentcapability to driver the camera and repeater unit, the vehicle batteryor ignition power shall supply to connector (31). The primary powersupply (32) shall be set to desired PoC voltage so the camera connectedto (34) can be sourced with PoC.

The Microcontroller (41) is present to initialize all the de-serializers(35) and serializers (42), (43), (44) on the board. It may be useful tobring any intelligence or control needed for the board in future. TheI2C bus is also connected to microcontroller (41) and FPGA (37) forcontrol or intelligent software behavior needed to switch ON/OFF variousMIPI busses. The system may also control the devices on the I2C bus suchthat only one of the LVDS receivers (not illustrated here) can send I2Cmessages through LVDS back channel.

Optionally, and with reference to FIG. 5, another embodiment is shownusing discrete off-the-shelf LVDS repeaters. However, since thoseoff-the-shelf ICs cannot be connected to the vehicle LVDS bus on (34),(45), (46), (47), the block diagram will remain almost the same as FIG.4, except with the FPGA (37) replaced by off-the-shelf LVDS repeater ICs(48).

The vision system and/or camera(s) may utilize aspects of the visionsystems and cameras described in U.S. Publication No. US-2017-0223306,which his hereby incorporated herein by reference in its entirety.

The camera or sensor may comprise any suitable camera or sensor.Optionally, the camera may comprise a “smart camera” that includes theimaging sensor array and associated circuitry and image processingcircuitry and electrical connectors and the like as part of a cameramodule, such as by utilizing aspects of the vision systems described inInternational Publication Nos. WO 2013/081984 and/or WO 2013/081985,which are hereby incorporated herein by reference in their entireties.

The system includes an image processor operable to process image datacaptured by the camera or cameras, such as for detecting objects orother vehicles or pedestrians or the like in the field of view of one ormore of the cameras. For example, the image processor may comprise animage processing chip selected from the EyeQ family of image processingchips available from Mobileye Vision Technologies Ltd. of Jerusalem,Israel, and may include object detection software (such as the typesdescribed in U.S. Pat. Nos. 7,855,755; 7,720,580 and/or 7,038,577, whichare hereby incorporated herein by reference in their entireties), andmay analyze image data to detect vehicles and/or other objects.Responsive to such image processing, and when an object or other vehicleis detected, the system may generate an alert to the driver of thevehicle and/or may generate an overlay at the displayed image tohighlight or enhance display of the detected object or vehicle, in orderto enhance the driver's awareness of the detected object or vehicle orhazardous condition during a driving maneuver of the equipped vehicle.

The vehicle may include any type of sensor or sensors, such as imagingsensors or radar sensors or lidar sensors or ladar sensors or ultrasonicsensors or the like. The imaging sensor or camera may capture image datafor image processing and may comprise any suitable camera or sensingdevice, such as, for example, a two dimensional array of a plurality ofphotosensor elements arranged in at least 640 columns and 480 rows (atleast a 640×480 imaging array, such as a megapixel imaging array or thelike), with a respective lens focusing images onto respective portionsof the array. The photosensor array may comprise a plurality ofphotosensor elements arranged in a photosensor array having rows andcolumns. Preferably, the imaging array has at least 300,000 photosensorelements or pixels, more preferably at least 500,000 photosensorelements or pixels and more preferably at least 1 million photosensorelements or pixels. The imaging array may capture color image data, suchas via spectral filtering at the array, such as via an RGB (red, greenand blue) filter or via a red/red complement filter or such as via anRCC (red, clear, clear) filter or the like. The logic and controlcircuit of the imaging sensor may function in any known manner, and theimage processing and algorithmic processing may comprise any suitablemeans for processing the images and/or image data.

For example, the vision system and/or processing and/or camera and/orcircuitry may utilize aspects described in U.S. Pat. Nos. 9,233,641;9,146,898; 9,174,574; 9,090,234; 9,077,098; 8,818,042; 8,886,401;9,077,962; 9,068,390; 9,140,789; 9,092,986; 9,205,776; 8,917,169;8,694,224; 7,005,974; 5,760,962; 5,877,897; 5,796,094; 5,949,331;6,222,447; 6,302,545; 6,396,397; 6,498,620; 6,523,964; 6,611,202;6,201,642; 6,690,268; 6,717,610; 6,757,109; 6,802,617; 6,806,452;6,822,563; 6,891,563; 6,946,978; 7,859,565; 5,550,677; 5,670,935;6,636,258; 7,145,519; 7,161,616; 7,230,640; 7,248,283; 7,295,229;7,301,466; 7,592,928; 7,881,496; 7,720,580; 7,038,577; 6,882,287;5,929,786 and/or 5,786,772, and/or U.S. Publication Nos.US-2014-0340510; US-2014-0313339; US-2014-0347486; US-2014-0320658;US-2014-0336876; US-2014-0307095; US-2014-0327774; US-2014-0327772;US-2014-0320636; US-2014-0293057; US-2014-0309884; US-2014-0226012;US-2014-0293042; US-2014-0218535; US-2014-0218535; US-2014-0247354;US-2014-0247355; US-2014-0247352; US-2014-0232869; US-2014-0211009;US-2014-0160276; US-2014-0168437; US-2014-0168415; US-2014-0160291;US-2014-0152825; US-2014-0139676; US-2014-0138140; US-2014-0104426;US-2014-0098229; US-2014-0085472; US-2014-0067206; US-2014-0049646;US-2014-0052340; US-2014-0025240; US-2014-0028852; US-2014-005907;US-2013-0314503; US-2013-0298866; US-2013-0222593; US-2013-0300869;US-2013-0278769; US-2013-0258077; US-2013-0258077; US-2013-0242099;US-2013-0215271; US-2013-0141578 and/or US-2013-0002873, which are allhereby incorporated herein by reference in their entireties. The systemmay communicate with other communication systems via any suitable means,such as by utilizing aspects of the systems described in InternationalPublication Nos. WO 2010/144900; WO 2013/043661 and/or WO 2013/081985,and/or U.S. Pat. No. 9,126,525, which are hereby incorporated herein byreference in their entireties.

The imaging device and control and image processor and any associatedillumination source, if applicable, may comprise any suitablecomponents, and may utilize aspects of the cameras (such as variousimaging sensors or imaging array sensors or cameras or the like, such asa CMOS imaging array sensor, a CCD sensor or other sensors or the like)and vision systems described in U.S. Pat. Nos. 5,760,962; 5,715,093;6,922,292; 6,757,109; 6,717,610; 6,590,719; 6,201,642; 5,796,094;6,559,435; 6,831,261; 6,822,563; 6,946,978; 7,720,580; 8,542,451;7,965,336; 7,480,149; 5,550,677; 5,877,897; 6,498,620; 5,670,935;5,796,094; 6,396,397; 6,806,452; 6,690,268; 7,005,974; 7,937,667;7,123,168; 7,004,606; 6,946,978; 7,038,577; 6,353,392; 6,320,176;6,313,454 and/or 6,824,281, and/or International Publication Nos. WO2009/036176; WO 2009/046268; WO 2010/099416; WO 2011/028686 and/or WO2013/016409, and/or U.S. Publication Nos. US 2010-0020170 and/orUS-2009-0244361, which are all hereby incorporated herein by referencein their entireties.

Optionally, the camera may comprise a forward facing camera, such asdisposed at a windshield electronics module (WEM) or the like. Theforward facing camera may utilize aspects of the systems described inU.S. Pat. Nos. 8,256,821; 7,480,149; 6,824,281 and/or 6,690,268, and/orU.S. Publication Nos. US-2015-0327398; US-2015-0015713; US-2014-0160284;US-2014-0226012 and/or US-2009-0295181, which are all herebyincorporated herein by reference in their entireties.

Optionally, the vision system may include a display for displayingimages captured by one or more of the imaging sensors for viewing by thedriver of the vehicle while the driver is normally operating thevehicle. Optionally, for example, the vision system may include a videodisplay device, such as by utilizing aspects of the video displaysystems described in U.S. Pat. Nos. 5,530,240; 6,329,925; 7,855,755;7,626,749; 7,581,859; 7,446,650; 7,338,177; 7,274,501; 7,255,451;7,195,381; 7,184,190; 5,668,663; 5,724,187; 6,690,268; 7,370,983;7,329,013; 7,308,341; 7,289,037; 7,249,860; 7,004,593; 4,546,551;5,699,044; 4,953,305; 5,576,687; 5,632,092; 5,677,851; 5,708,410;5,737,226; 5,802,727; 5,878,370; 6,087,953; 6,173,508; 6,222,460;6,513,252 and/or 6,642,851, and/or U.S. Publication Nos.US-2012-0162427; US-2006-0050018 and/or US-2006-0061008, which are allhereby incorporated herein by reference in their entireties. Optionally,the vision system (utilizing the forward facing camera and a rearwardfacing camera and other cameras disposed at the vehicle with exteriorfields of view) may be part of or may provide a display of a top-downview or birds-eye view system of the vehicle or a surround view at thevehicle, such as by utilizing aspects of the vision systems described inInternational Publication Nos. WO 2010/099416; WO 2011/028686; WO2012/075250; WO 2013/019795; WO 2012/075250; WO 2012/145822; WO2013/081985; WO 2013/086249 and/or WO 2013/109869, and/or U.S.Publication No. US-2012-0162427, which are hereby incorporated herein byreference in their entireties.

Changes and modifications in the specifically described embodiments canbe carried out without departing from the principles of the invention,which is intended to be limited only by the scope of the appendedclaims, as interpreted according to the principles of patent lawincluding the doctrine of equivalents.

1. A vision system of a vehicle, said vision system comprising: a cameradisposed at a vehicle and having a field of view exterior of thevehicle; wherein said camera captures image data and outputs a lowvoltage differential signal (LVDS); wherein said LVDS repeater receivesthe LVDS signal output by said camera and outputs at least two LVDSoutputs to respective receivers, and wherein each of the at least twoLVDS outputs is representative of the LVDS signal output by said camera;and wherein said receivers comprise a receiver of respective ones of atleast two devices selected from the group consisting of (i) a vehiclehead unit of the vehicle, (ii) a display device of the vehicle, (iii) anelectronic control unit of the vehicle and (iv) an image processor for adriver assistance system of the vehicle.
 2. The vision system of claim1, wherein said LVDS repeater outputs a first LVDS output to a receiverof a vehicle head unit of the vehicle and outputs a second LVDS outputto a receiver of an electronic control unit of the vehicle.
 3. Thevision system of claim 1, wherein said LVDS repeater outputs at leastthree LVDS outputs to respective ones of three receivers.
 4. The visionsystem of claim 3, wherein said LVDS repeater outputs a first LVDSoutput to a vehicle head unit of the vehicle, outputs a second LVDSoutput to a first electronic control unit of the vehicle, and outputs athird LVDS output to a second electronic control unit of the vehicle. 5.The vision system of claim 3, wherein said LVDS repeater outputs a firstLVDS output to a receiver of a vehicle head unit of the vehicle, outputsa second LVDS output to a receiver of an image processor for a driverassistance system of the vehicle, and outputs a third LVDS output to anelectronic control unit of the vehicle.
 6. The vision system of claim 1,wherein said LVDS repeater comprises (i) a de-serializer thatdeserializes the received LVDS signal output by said camera, (ii) afield-programmable gate array that receives a deserialized signal fromthe de-serializer and outputs at least two outputs, (iii) at least twoserializers that each receive a respective one of the outputs from thefield-programmable gate array and output the respective LVDS output tothe respective receiver.
 7. The vision system of claim 6, wherein thefield-programmable gate array outputs at least two Mobile IndustryProcessor Interface (MIPI) outputs.
 8. The vision system of claim 1,wherein said LVDS repeater comprises (i) a de-serializer thatdeserializes the received LVDS signal, (ii) at least two discrete LVDSrepeaters that receive a respective deserialized signal from thede-serializer and that output a respective output, (iii) at least twoserializers that each receive a respective output from a respective oneof the LVDS repeaters and output the respective LVDS output to therespective receiver.
 9. The vision system of claim 8, wherein the LVDSrepeaters output respective Mobile Industry Processor Interface (MIPI)outputs.
 10. The vision system of claim 1, wherein said LVDS repeater ispowered via a power signal received through one of the LVDS output linksto the receivers.
 11. A vision system of a vehicle, said vision systemcomprising: a camera disposed at a vehicle and having a field of viewexterior of the vehicle; wherein said camera captures image data andoutputs a low voltage differential signal (LVDS); wherein said LVDSrepeater receives the LVDS signal output by said camera and outputs atleast two LVDS outputs to respective receivers, and wherein each of theat least two LVDS outputs is representative of the LVDS signal output bysaid camera; wherein said receivers comprise a receiver of respectiveones of at least two devices selected from the group consisting of (i) avehicle head unit of the vehicle, (ii) a display device of the vehicle,(iii) an electronic control unit of the vehicle and (iv) an imageprocessor for a driver assistance system of the vehicle; wherein saidLVDS repeater comprises (i) a de-serializer that deserializes thereceived LVDS signal output by said camera, (ii) a field-programmablegate array that receives a deserialized signal from the de-serializerand outputs at least two outputs, (iii) at least two serializers thateach receive a respective one of the outputs of the field-programmablegate array and output the respective LVDS output to the respectivereceiver; and wherein said LVDS repeater is powered via a power signalreceived through one of the LVDS output links to the receivers.
 12. Thevision system of claim 11, wherein said LVDS repeater outputs a firstLVDS output to a receiver of a vehicle head unit of the vehicle andoutputs a second LVDS output to a receiver of an electronic control unitof the vehicle.
 13. The vision system of claim 11, wherein said LVDSrepeater outputs at least three LVDS outputs to respective ones of threereceivers.
 14. The vision system of claim 13, wherein said LVDS repeateroutputs a first LVDS output to a vehicle head unit of the vehicle,outputs a second LVDS output to a first electronic control unit of thevehicle, and outputs a third LVDS output to a second electronic controlunit of the vehicle.
 15. The vision system of claim 11, wherein thefield-programmable gate array outputs at least two Mobile IndustryProcessor Interface (MIPI) outputs.
 16. A vision system of a vehicle,said vision system comprising: a camera disposed at a vehicle and havinga field of view exterior of the vehicle; wherein said camera capturesimage data and outputs a low voltage differential signal (LVDS); whereinsaid LVDS repeater receives the LVDS signal output by said camera andoutputs at least two LVDS outputs to respective receivers, and whereineach of the at least two LVDS outputs is representative of the LVDSsignal output by said camera; wherein said receivers comprise a receiverof respective ones of at least two devices selected from the groupconsisting of (i) a vehicle head unit of the vehicle, (ii) a displaydevice of the vehicle, (iii) an electronic control unit of the vehicleand (iv) an image processor for a driver assistance system of thevehicle; wherein said LVDS repeater comprises (i) a de-serializer thatdeserializes the received LVDS signal, (ii) at least two discrete LVDSrepeaters that receive a respective deserialized signal from thede-serializer and that output a respective output, (iii) at least twoserializers that each receive a respective output from a respective oneof the LVDS repeaters and output the respective LVDS output to therespective receiver; and wherein said LVDS repeater is powered via apower signal received through one of the LVDS output links to thereceivers.
 17. The vision system of claim 16, wherein said LVDS repeateroutputs a first LVDS output to a receiver of a vehicle head unit of thevehicle and outputs a second LVDS output to a receiver of an electroniccontrol unit of the vehicle.
 18. The vision system of claim 16, whereinsaid LVDS repeater outputs at least three LVDS outputs to respectiveones of three receivers.
 19. The vision system of claim 18, wherein saidLVDS repeater outputs a first LVDS output to a vehicle head unit of thevehicle, outputs a second LVDS output to a first electronic control unitof the vehicle, and outputs a third LVDS output to a second electroniccontrol unit of the vehicle.
 20. The vision system of claim 16, whereinthe LVDS repeaters output respective Mobile Industry Processor Interface(MIPI) outputs.